When perceptual time stands still: Long stable memory in binocular rivalry 
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We have carried out binocular rivalry experiments with a large number of subjects to obtain high 
quality statistics on probability distribution of dominance duration (PDDD) for two cases where 
(a) the rival stimulus is continuously presented and (b) the rival stimulus is periodically removed, 
with stimulus-on and stimulus-off intervals T on and T ff respectively. It is shown that the PDDD 
obtained for the latter case can be reproduced to a reasonable degree of approximation by simply 
using the PDDD of part (a) and slicing it at pieces of time extent T on and by introducing intervals 
of length T Q ff between the on-intervals where the PDDD is set to zero. This suggests that the 
variables representing the perceptual state do not change significantly during long blank intervals. 
We argue that these findings impose challenges to theoretical models which aim at describing 
visual perception. 



I. INTRODUCTION 



Bistable perception ( Leopold and Logothetisl . fl999l) is 
the spontaneous alteration between two perceptual states 
which occurs upon presentation of an ambiguous stimu- 
lus. A form of bistable perceptio n is binocular rivalry 
(BR) ([Blake and LogothetisL |2003 ) where each retina is 
presented with a different image dichoptically; the ob- 
server experiences perceptual rivalry between the two 
different percepts which correspond to the images pre- 
sented to the two retinas. This phenomenon can be use- 
ful in neuroscience for many different reasons; for ex- 
ample, it permits dissociation of neural activity which 
corresponds to conscious perception from that which is 
related to sensory stimulation and, thus, it has been 
used as a to ol to investigate t he ne u ral correlates o f con- 
sciousness (I Crick and Kochl If 9951: ISterzer et all. 12009} : 



Sterzer and Reest 120081: ISterzer et all l2002t iTong et al 
20061) 



Nearly hal f a century ago, it was discovered 
( Orbach et all [T966[) that intermittent presentation of a 
bistable pattern, which appears and disappears every few 
seconds, decreases the frequency of perceptual changes in 
bistable percep t ion. In a more recent remarkable study 
([Leopold et all l2002h . it was demonstrated that a pe- 
riodic removal of the stimulus, which causes bistable 
perception, can lead to nearly freezing the same per- 
ception of the rival s timulus. Following these measure- 
ments, Chen and He ([Chen and Hei . [20041. in the case of 
binocular rivalry, allowed for swapping of the two rival 
stimuli between the two eyes during intermittent presen- 
tations. They found that the stabilization occurs only 
when the same stimulus was presented to the same reti- 
nal lo cation. Furthermore, Chen a nd He dChen and He , 
2004|) and Pearson and Clifford ( Pearson and Clifford , 



20041 ) have studied the consequence of swapping other 



characteristics of the stimuli, such as color and orienta- 
tion. These results have been interpreted that the neu- 
ral processing of the bistable stimuli invo lves a form of 
memory storage across the bl ank interval ( O'Sheal 12004 
iPearson and Brascampl 120081) . 



While for the case of binocular rivalry with continu- 
ous stimulus there are available results for the so-called 
probability d i stribut i on of dominance duration (PDDD) 
(|Lehkv! . [l995lLeveltl .[ 19681) , so far, there are no studies of 
the PDDD for the case of periodically interrupted stim- 
ulus. One reason for the lack of such studies may be the 
fact that, in order to obtain reasonably good statistics of 
the PDDD in the case of interrupted stimulus, compared 
to the continuous stimulus case, a much larger total sub- 
ject test-time is required. In this paper we have carried 
out binocular rivalry experiments using a large number of 
subjects for high-quality statistics to obtain the probabil- 
ity distribution of dominance duration (PDDD) for two 
cases where (a) the stimulus is continuous and (b) the 
stimulus is periodically removed. The definition of the 
PDDD for case (a) is well-known. We define the PDDD 
for case (b) as the probability density for a perceptual 
change to occur at time t, measured from the time of the 
previous percept change, under the condition that the 
stimulus on-off periodic cycle starts at precisely the time 
of the previous recorded event of percept change. 

We find that the PDDD for the case where the stimulus 
is periodically removed with stimulus-on and stimulus-off 
intervals T on and T D ff respectively, can be constructed 
from the PDDD which is obtained for continuously pre- 
sented stimulus by simply slicing the distribution to 
pieces of time extent T on and introducing intervals of 
time extent T D ff between these slices where the PDDD 
is set to zero. Inversely, starting from the PDDD ob- 
tained with the periodically removed stimulus and sim- 
ply erasing the blank intervals and "sewing" together the 
stimulus-on pieces of the distribution, the PDDD for con- 
tinuous stimulus can be approximately constructed. This 
suggests that there is approximately no significant change 
of the state of the perceived stimulus during the blank 
intervals. 

The paper is organized as follows. In Sec. [H] we discuss 
what precisely we measured and we present the technical 
details of the method used. In Sec. IIII1 we discuss the 
experimental results for the cases of continuous and pe- 
riodically interrupted stimulus. In Sec. IIII.Al we analyze 
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our results using the results for continuous PDDD and in 
Sec. [V] we discuss what we believe our results mean for 
our understanding of the phenomenon of binocular ri- 
valry and for the constraints that they imply for theories 
of bistable perception. 

II. EXPERIMENTAL METHOD 




Figure 1 Top: The image or stimulus which is presented to 
the subjects. Bottom: The images as seen by the left and right 
retina when the subjects wear glasses which have red/blue 
filters for the left and right eye respectively 



A. Subjects 

A large number of subjects (53 total) participated in 
the experiments reported in the present work and they 
were all undergraduate students at Florida State Univer- 
sity (FSU). The project received prior approval by the 
FSU Human Subjects Committee and the students who 
agreed to participate in this study signed an appropriate 
consent form. In order to achieve good statistical qual- 
ity of the probability distribution, especially for the case 
of periodically removed stimulus, such a large number of 
subjects was necessary. 

B. Apparatus and Stimuli 

A stimulus similar to the image shown as in Fig. Q] (top) 
was projected on a Viewsonic Optiquest Q71 17" CRT 
display (at 1024 x 768 resolution and 60-Hz refresh rate) 
with 0.23 mm dot pitch which was connected to a com- 
puter; the display was controlled through a written and 



compiled Labview application running under the Win- 
dows operating system. This application a) takes input 
from the mouse interrupt when the mouse button was 
pressed by the subject, b) records the time of such an 
event, and c) resets the timer which controls the periodi- 
cally presented stimulus to zero when the subject presses 
the mouse button (see discussion below). Each subject 
was viewing the stimulus by wearing a pair of glasses 
which had a red and a blue filter for the left and right 
eye respectively. The colors of the image, as viewed on 
the above described display, were carefully chosen such 
that, through the red/blue filters used, the left or right 
retina would see clear horizontal or vertical stripes simi- 
lar to those shown on the left or the right bottom of Fig[T] 
The images shown at the bottom of Fig. [TJ when viewed 
in color (in the on-line version not the printed version of 
the paper), are similar to what an observer sees through 
the filters by closing the other eye. The actual size of 
the stimulus was 4.5 cm x 4.5 cm and was set at a dis- 
tance of 100 cm from the subject's eyes (2.6° x 2.6° and 
0.32° distance between two successive horizontal or ver- 
tical stripes). With the choice of contrast level made for 
the two sets of stripes, we found that the average domi- 
nance duratio n for either eye was approximately the same 
(TLeveltl . ll968lh 



The stimulus was periodically presented for a time 
interval T on and removed for a time interval T e, as 
long as there was no indication that the subject per- 
ceived a change. Fig. [2] (top) schematically presents the 
"on" (shaded area) and "off" (blank) periods in which the 
stimulus is presented in a periodic fashion. The subjects 
were instructed to press a computer mouse button when 
they perceive a change in the percept, i.e., from horizon- 
tal to vertical stripes or vise versa. When the subject 
presses the button an event is registered and at the same 
time, the clock that measures the length of the presen- 
tation of the stimulus is reset at the beginning of the 
periodic cycle. This is shown in Fig. [2fbottom) where, 
at the indicated instant t in time, the observer has caused 
a recording of an event; then the stimulus stays on for an 
interval T on starting from the moment t and, if no other 
event registers in the mean time, the stimulus goes off for 
an interval T Q fj and so on until the interrupt connected 
to the mouse registers a new event. This was achieved 
using Labview programming in which the interrupt con- 
nected to the mouse is coupled to the loop which causes 
the periodic "on-off" cycle. When the interrupt picks 
up the signal from the mouse input, it resets the loop 
which produces the periodic cycle. At the end of the 
procedure a file containing the time series of the events 
to,ti,t2,...,t n ,t n +i,..., for any given subject is stored on 
a specified directory labeled by the observer's assigned 
identification number. 
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Intermittently presented stimulus 
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Resulting pattern of displayed stimulus 

Figure 2 Schematic drawing of the process of the periodic 
removal of the stimulus. The gray-shaded areas labeled as 
T on denote the periods where the stimulus is presented to the 
subject and the blank areas labeled as T Q g denote the time 
intervals where the stimulus is removed. At an instant of time 
t, indicated by the arrow, the subject responds to a perceptual 
change by pressing the button. Then the sequence of on-off 
periods is substituted by a new sequence shown in the second 
row where the beginning of the periodic process starts at time 
t. The resulting pattern of stimulus on-off periods is shown 
in the bottom part of the above figure. 



C. Procedure 

Before the actual experiment, each observer was asked 
to wear the glasses and was presented with the image 
of Fig. [1] (top) to make sure that he can experience ri- 
valry. Then, another quick test was carried out where 
the observer was presented with the same stimulus but, 
this time, it was periodically removed and the observer 
was also asked to press the button when he perceived a 
change from the image with the stripes being horizontal 
(blue) to an image with vertical stripes (red) and vice 
versa. The subject was told to pay attention, when the 
image disappears and comes back, whether or not the 
percept comes back different and if so to press the but- 
ton if not to wait until it changes. Then the subject 
was informed that with his/her permission three actual 
experiments would be carried out next: in one, the stim- 
ulus would be continuous, in the second and third, the 
stimulus would be periodically removed. The subjects 
were also informed that the duration of each of these 
three experiments would be approximately 10 minutes. 
Because some subjects either had limited time available 
to devote to the experiments or because they experienced 
some degree of fatigue at the end of the first experiment 
(continuous stimulus) or the second experiment they were 
not asked to participate in all three cases planned. As 
a result in the case of continuous stimulus, which was 
carried out first, all 53 observers participated in the ex- 
periments. In the other two cases with the periodically 
removed stimulus, only 42 observers participated in one 



case (with T on = 1.1 sec and T Q ff = 3.1 sec) and only 40 
observers participated in the other case (with T on = 2.2 
sec and T Q ff = 3.1 sec). 

In producing the histograms, the time series of the 
events to, t\, t2,...,t n , t n +i,..., for any given subject, is 
converted to a series 8t\ = t\ — to, 8t% = t% — ti, 
St n = t n+ i — t n , ... of elapsed times between events and 
the histogram of these intervals is shown in Fig. [31 Fig. @] 

The case of continues stimulus is obtained when T on is 
set to be longer than the time that the entire experiment 
lasts. 



III. RESULTS 

A. Continuous stimulus 

The stimulus shown in Fig. [T] was continuously pre- 
sented to 53 subjects through the two different filters for 
each eye as discussed above for approximately 10 minutes 
per subject. A total number of 16435 responses (events) 
were recorded. In Fig. [3] we present the histogram of the 
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Figure 3 The probability distribution of dominance duration 
obtained obtained by averaging across subjects. 



B. Periodic removal of stimulus 

Here, we will present the results of our experiments 
where the stimulus was periodically removed as discussed 
in Sec. Hfl The intervals Sti of elapsed time between suc- 
cessive responses are the dominance durations of either 
percept given the constraint that, starting from the onset 
of a perceptual change, the stimulus is kept on for a time 
T on and, then, the stimulus is turned off for an amount 
of time T ff, etc., until the next perceptual change oc- 
curs at which point in time, the clock is reset to zero 
and the onset of a new periodic cycle starts. Data were 



collected for 40 observers for the case where T Q 



2.2 



sec and T a = 3.1 sec, and the histogram of the Sti is 
shown in Fig. HjTop). In Fig. ^Bottom) the results are 



4 




6 8 10 12 14 
Dominance Duration 



Figure 4 (Top) The measured probability distribution of 
dominance duration (PDDD) averaged over 42 subjects for 
T on = 2.2 sec and T D g = 3.1 sec. (Bottom) The measured 
PDDD averaged over 40 subjects for the case of T on = 1.1 sec 
and T ff =3.1 sec. 
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(a) Measured Distribution 




(b) From Slicing the Continuous Distribution 
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Figure 6 The measured PDDD for the case of T on = 2.2 
sec, Toff = 3.1 sec (Top) and for the case of T on = 1.1 sec, 
Toft =3.1 sec (Bottom) is compared to the distribution shown 
as an inverted curve (part b), which is obtained by slicing the 
C(t), i.e., the one for continuous stimulus. 
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Figure 5 Illustration of how to obtain the probability distri- 
bution of dominance duration (PDDD) for the case where the 
stimulus is periodically interrupted from the PDDD obtained 
for the case of continuous stimulus presentation. The PDDD 
for continuous stimulus is sliced at segments of duration T on 
and, then, they are separated by blank intervals of duration 
Toft . Thus, we obtain the PDDD for interrupted stimulus 
shown in Fig. [6] 



presented for the case of 42 observers when T on = 1.1 sec 
and T ff = 3.1 sec. 



IV. ANALYSIS OF THE RESULTS 

As illustrated in Fig. [5j the experimental PDDD ob- 
tained for continuous stimulus (after proper normaliza- 
tion to the same number of events) is sliced in parts of 
width equal to T on and, then, these parts are separated 
by intervals of time extent T D ff as shown in the inverted 
curves of Fig. [B] Namely, a discontinuous PDDD D(t), 
to be compared with the case of periodically interrupted 
stimulus, is constructed using the PDDD C(t) for the 
case of continuous stimulus presentation, as follows: 



D(t) 



nT f f ) , nT < t < nT + 
otherwise 







(1) 



where n = [i] (the brackets stand for the integer part) 
and T = T on + T ff, the period of the on and off process. 

Notice in FigJS] that several of the main features of 
the PDDD for the case of interrupted stimulus are rea- 
sonably well reproduced using the PDDD for continuous 
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Figure 7 The measured probability distribution of time-delay 
St of the reported time (due to finite human reaction) from 
the time (as measured by a photo-diode) where the stimulus 
actually disappears. The solid line is a Lorentzian fit. 



stimulus by this procedure. For example, the number 
of on-intervals where there is a significant probability as 
well as the distribution of the probability in each of the 
on-intervals is similar. Furthermore, when the value of 
T on is smaller the number of on-interval with significant 
probability increase. 

Some of the differences between the sliced-up continu- 
ous distribution (Eq. [TJ and the experimental PDDD for 
the intermittent stimulus can be reconciled as follows. 
As it may be noticed, there are gaps of events in the off 
intervals, however, there are also events which fall in the 
gaps. The main reasons for this are 
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Figure 8 The measured PDDD for the case of T on = 2.2 sec, 
T ff = 3.1 sec (Top) for the case of T on = 1.1 sec, T Q ff = 3.1 
sec (Bottom) sec is compared to the distribution shown as an 
inverted curve (part b), which is obtained by slicing the C(i), 
i.e., the one for continuous stimulus where a 0.3 sec is added 
due to time-delay due to finite human reaction time. 



(a) the observer's finite response time and 

(b) when the stimulus reappears, the observer delays to 
give his/her response mainly because it takes time to 
make a decision on whether or not the percept is the 
same with the one perceived at the end of the previous 
stimulus presentation. 

In order to make sure that this is not due to an equip- 
ment delay caused by some unknown factor, we use a 
photo-diode to measure the physical values of T on and 
T Q ff. Namely, a photo-diode connected to an oscilloscope 
is placed in front of the computer monitor and, thus, the 
oscilloscope registers different voltage values depending 
on whether on the computer monitor the image/stimulus 
is on or off. Using the same experimental equipment, i.e., 
computer, monitor and software, we presented the same 
stimulus with the same two conditions of on and off times 
presented to the observers. We found that both T on and 
T ff were very close (within less than 10 milliseconds) to 
the input values used in this study. 

Then, we carried out a different experiment to measure 
the time delay St in human response from the actual time 
the stimulus goes off to the time recorded. For this exper- 
iment the same stimulus was periodically presented and 



removed to observers (this time without wearing glasses) 
and we asked them to respond when they saw the stim- 
ulus disappearing. In Fig. [7] we present the distribution 
of the time-delay measured from the actual time where 
the stimulus is removed. Notice that the responses peak 
at (5t m ax = 0.34 sees. The solid line is a Lorentzian fit, 
i.e., to the form C/((t - t ) 2 + e 2 ) which gives t = 0.335 
sees and e = 0.0303 sees. 

Guided by this observation we re-analyzed the PDDD 
data for the two cases studied here in a different way 
with the intention to take into consideration this delay 
in human reaction time. Fig. [8] compare the measured 
PDDD for the two cases studied here with the PDDD 
obtained by slicing the one for continuous stimulus where 
a time-delay of St = 0.3 sec has been included as follows 
in order to take into account the finite human reaction 
time. The first slice of C(t) is taken at T on + St instead 
of at T on , and the time at which the stimulus reappears 
is taken to be T + St. Notice that the agreement with 
the observed PDDD has improved rather significantly. 

In Fig. |5] the measured PDDD for the two cases studied 
here is compared with the PDDD obtained as discussed 
in the previous paragraph (for Fig.[5]and, in addition, the 
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(a) Measured Distribution 
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Figure 9 The measured PDDD for the case of T on = 2.2 sec, 
T ff = 3.1 sec (Top) and for the case T on = 2.2 sec, T g = 3.1 
sec (Bottom) is compared to the distribution shown as an 
inverted curve (part b), which is obtained by slicing the C(i), 
i.e., the one for continuous stimulus where a 0.3 sec is added 
due to time-delay caused by finite human reaction time and, 
in addition, by using a Lorentzian broadening of the responses 
with the independently measured width of e = 0.03 sees. 



distribution is broadened by a Lorentzian with width e = 
0.03, i.e., exactly the same width found experimentally 
for the reaction-time distribution (Fig. [7]) Notice that 
the agreement with the observed PDDD has improved 
further. 

Notice, however, that the distribution obtained by just 
slicing C(t) has a peak very close to the on-set of the new 
periodic cycle while the experimental peak is delayed. 
This behavior is very similar in all of the on-intervals. 
We believe that this is due to the fact (b) discussed above 
namely, that when the interrupted stimulus reappears, 
the observer, in addition, to the standard response time, 
he needs time to make a conscious decision on whether 
the percept is the same or different with the one he was 
experiencing when the stimulus went off. 



large number of subjects were used in order to obtain 
reasonably good statistics. 

Our analysis of our results demonstrates that, to a rea- 
sonable approximation, the main features of the PDDD 
with interrupted stimulus can be obtained from the 
PDDD which corresponds to the continuous stimulus by 
simply slicing the latter and introducing no response be- 
tween the sliced intervals. Inversely, if we put-together 
the pieces of the PDDD corresponding to the case of in- 
terrupted stimulus we obtain the PDDD corresponding 
to the case of continuous stimulus presentation. 

The results of the experiments reported in the present 
work, imply that there is no significant change and no 
significant decay of the memory of the perceived state 
during the stimulus interruptions. While physical time 
is the parameter that follows the physical change (evolu- 
tion), we can define "perceptual time" as the parameter 
which characterizes perceptual change. This latter time, 
to a large extent, halts during the intervals of the stimu- 
lus interruption. 

Adaptation-inhibition models cannot explain the per- 
ceptual stabilization upon stimulus interruption. In or- 
der to describe perceptual sta bilization of interr upted 
ambiguous stimuli, Noest et al. ( Noest et al. 1 . 1200*71 ) have 
introduced a model in which percept-choice at stimu- 
lus onset differs fundamentally from percept-switching 
due to inclusion of interaction between "shunting" adap- 
tation and a near-threshold neural baseline. In order 
to describe the stabilizat ion of the per ceptual state in 
binocular rivalry Wilson ( Wilsonl . 120071 ) has introduced 
a model in which he assumes a rapid synaptic potentia- 
tion followed by a significantly slower depression back to 
the original level. However, it is not at all obvious that 
the above models can reproduce this measured behavior 
of the PDDD. In both theoretical models, the dynamical 
variables which represent the perceived state evolve dur- 
ing the blank intervals; however, the present experimen- 
tal results suggest that the perceptual state is approxi- 
mately unaffected by time during stimulus interruptions 
(which last for several seconds) as shown in the present 
experiment. This experiment was motivated by a theo - 
retical work of the present author ( Manousakisl l2009t) ■ 
The experimental results of the present paper are in rea- 
sonable agreement with the prediction of that theory, i.e., 
Eq. Q] It may still be premature to accept the rather rad- 
ical t heoretical point of v iew of our previous theoretical 
work (jManousa kis. 2009) without further investigation; 
however, the experimental results of the present study 
are significant because they should serve as a benchmark 
by which to test any theory of bistable perception. 
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